Papers with Agentic Reinforcement Learning
Exploring Reasoning Reward Model for Agents (2026.findings-acl)
Copied to clipboard
Kaixuan Fan, Kaituo Feng, Manyuan Zhang, Tianshuo Peng, Zhixun Li, Yilei Jiang, Shuang Chen, Xiangyu Yue
| Challenge: | Existing methods for agentic reinforcement learning rely on sparse outcome-based reward for training, leading to suboptimal results. |
| Approach: | They propose an agent-based reward model that produces structured feedback for agentic trajectories, including an explicit reasoning trace and a focused critique. |
| Outcome: | The proposed model produces structured feedback for agentic trajectories including an explicit reasoning trace, a focused critique, and an overall score that evaluates process performance. |
SQL-ASTRA: Alleviating Sparse Feedback in Agentic SQL via Column-Set Matching and Trajectory Aggregation (2026.findings-acl)
Copied to clipboard
| Challenge: | Agentic SQL is a framework for multiturn agent learning, but it is limited to single-turn paradigms. |
| Approach: | They propose a framework that provides a universal two-tiered reward mechanism for credit assignment . they propose 'Aggregated Trajectory Reward' to resolve multi-turn credit assignment. |
| Outcome: | The proposed framework outperforms SOTA Arctic-Text2SQL-R1-7B on BIRD and Spider 2.0 using identical models. |
AT²PO: Agentic Turn-based Policy Optimization via Tree Search (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have catalyzed the development of autonomous agents capable of executing complex, multi-turn tasks. |
| Approach: | They propose a framework for agentic reinforcement learning that integrates turn-level tree search with tree search to address key challenges. |
| Outcome: | The proposed framework addresses key challenges: limited exploration diversity, sparse credit assignment, and misaligned policy optimization. |
SOAR: Supervision from Observation for Agentic Reinforcement Learning (2026.acl-long)
Copied to clipboard
| Challenge: | Prior work assigns supervision based on outcome rewards or external reward models, but ignores environment observations, a critical source of learning. |
| Approach: | They propose a supervision-based agentic reinforcement learning system that integrates environment observations as an explicit supervision signal. |
| Outcome: | The proposed model improves performance on reasoning and deep research tasks while reducing erroneous and inefficient tool usage. |